Relative Error Streaming Quantiles
نویسندگان
چکیده
Estimating ranks, quantiles, and distributions over streaming data is a central task in analysis monitoring. Given stream of n items from universe equipped with total order, the to compute sketch (data structure) size polylogarithmic . query item y , one should be able approximate its rank stream, i.e., number elements smaller than or equal Most works date focused on additive ε error approximation, culminating KLL that achieved optimal asymptotic behavior. This paper investigates multiplicative (1 ± ε)-error approximations rank. Practical motivation for stems demands understand tails distributions, hence sketches more accurate near extreme values. The most space-efficient algorithms due prior work store either O (log (ε 2 )/ε ) 3 )/ε) items. We present randomized storing 1.5 can ε)-approximate each high constant probability; this space bound within an \(O(\sqrt {\log (\varepsilon n)}) \) factor optimal. Our algorithm does not require knowledge length fully mergeable, rendering it suitable parallel distributed computing environments.
منابع مشابه
Frugal Streaming for Estimating Quantiles
Modern applications require processing streams of data for estimating statistical quantities such as quantiles with small amount of memory. In many such applications, in fact, one needs to compute such statistical quantities for each of a large number of groups (e.g.,network traffic grouped by source IP address), which additionally restricts the amount of memory available for the stream for any...
متن کاملEstimating Quantiles from the Union of Historical and Streaming Data
Modern enterprises generate huge amounts of streaming data, for example, micro-blog feeds, financial data, network monitoring and industrial application monitoring. While Data Stream Management Systems have proven successful in providing support for real-time alerting, many applications, such as network monitoring for intrusion detection and real-time bidding, require complex analytics over his...
متن کاملFrugal Streaming for Estimating Quantiles: One (or two) memory suffices
Modern applications require processing streams of data for estimating statistical quantities such as quantiles with small amount of memory. In many such applications, in fact, one needs to compute such statistical quantities for each of a large number of groups, which additionally restricts the amount of memory available for the stream for any particular group. We address this challenge and int...
متن کاملAn error concealment algorithm for streaming video
A known problem in video streaming is that loss of a packet usually results into loss of a whole video frame. In this paper we propose an error concealment algorithm specifically designed to handle this sort of losses. The technique exploits information in a few past frames (namely the motion vectors) in order to estimate the forward motion vectors of the last received frame. This information i...
متن کاملParallel Streaming Computation on Error-Prone Processors
Hardware fault rates are increasing due to decreasing transistor sizes in newer technology nodes. To ensure reliability, circuits need more redundancy and higher voltage margins, incurring high area/performance/energy overheads. Since some applications, such as multimedia processing and streaming applications, can tolerate some types of errors, approximate computing research has begun exploring...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of the ACM
سال: 2023
ISSN: ['0004-5411', '1557-735X']
DOI: https://doi.org/10.1145/3617891